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= a _. .“Data-based IEP Development: s. 2 ” 
. ef : few . 
An Appreach to Substantive Compliance* 4 


A, 
: 


As never before, (special) eceeers are being called upon to- docu- 
? 


fiegt the effectiveness of modifications in the programs of individual 
Yatudents. State and federal régiilakions designed to ensure procedyral 
ww 7 + > 
a "safeguards for the right to due process require that decisions to phanike 
y : . 


a program be based on evidence regardjng what- is best for we 


i Veaneeees of due process hearings frequently — on the data chat is 
.°< presented by parties involved in the hearing. Distribution of. money . 
allocated for spe¢ial’éducation services is basedien the sudticiency-ot 
“aaa gent epsceauies ied in determining eligibility. At the eae time, 


| the measures that educators 4nd psychologists have traditionally used to 
ied . . x . ~ . 
assess exceptional students have been criticized as biased, technically 
{ 
inadequate, and appfopriate for BECUups vatlior than, individuals (Ysseldyke, 


; \o79). . , s : os aes 


* ’ 
’ . 


e e } 
F _ One important effect of the demand for atcountability and .docymeh- 


_ tation in oe ts TEP decisions. has been excessive concern over compliance 


° 


ae “- with ae. procedural requirements of P.L. 94~142 and jts eénuiae (ans, with ‘ 


, 
some loss in concern for substantive conplf{ance (Prehm & McDonald, 1979), 
a’) a ' YZ 
While. procedural come fence eisures (as.some wits have: put it) "staying 
. . = e & 
s not pyarantee substantive compliance -- the. develop- 


out of jail," it d 


ment of a succegsful progrdm for an individual student. The distinction 


j 
oe a 
* ~ ee \. r ¢ , 
Some of the essential fideas presented here are based on concepts in Data- 
: * ,Based Rrogram Modificdtion by $. Ls:Deno and P. kK. Mirkin (Reston, Va.t 
Counci ‘for Except ionpl’ Gna TGEER “1977). 0 ‘ 


i . PY “= & 2 ‘ 
» a ae en) . ; 


ne 


ae . For a‘ period ef seven years, we epene & Mirkin, ie have Seas - 
7 "* % developing a structured, -data~based re to develubane individual ' 4 3 
pa ° , Re . * 7 i 

vas educational. programs that derives from the evaluation model developed. - 


ae oe by the Center for the Study of Evaluation (Klein, Fenstermacher, & Aiken, * % ° 


N ° . 


19721), and that rests ial od on the research iethods used to study °° 
treatment effects with sineie subjects (Hersen’& Barlow, 1976). The, 

details of that ° rs which’ we call *bate-Based Progran Modifica- 

tion (DBPM)," are beyond the scope of this paper.’ We ‘will, instead, _; 
present only ‘the major elements of the approach as they apply to : hares 


a _ developing an IEP for a single special education student, -We believe 


that thigNapproach results in both procedural and cubs tintive compliance 


° 


with the requiremerts of, P.L. 94-142... ' 
» : - ° : : 2 os rn Y 


_* Major Assymptions -_ : ; oa 
) = y oe ‘ 4 - 
7 ‘ several critical assumptions about special educa- ” 


e 
‘ ‘ 


‘. Lis ‘Special | ducation is an intervention System, designed to 


\ , 3 : 
a . A = e 
° , individuals. 
» \ ° : 
: ¥ 2. The purpose of special education intervention is to improve 
individual educational programs. /, 
, 3. The chance that any change in an individual's program will 
° . actually be an improvement is low enough to require that we fi 
, P) : o. * 4 
- » should continuously evaluate:the effects of program changes. 
~ ? * ‘ / 
; Eiements SF the DBPM. Model : . 
° ; & 
.° Within DBPM there are identified five decision areas and five 
: . U 


concomitant ‘data ga hering .phases. Each decision are addresses a 


F . s ‘ « . ‘ . 
’ . different program elopment’ question afd requires data gathering as .° 
gy - ~ : a » . : 4 ~ eee ae 
i‘ ; the basis for: decision making. a ' wo % 
* <4 \ _  F . ; ; - ! 


Table 1 identifies the questions to be answereg and the data:to be 


: gathered during each of the Pigoaraaeas phases in relation to.the five - ‘ 


decision areas. It should be noted-that the information gathering ket i- 


. | Wities that are specified are often the responsibjlity of one or more 


¢ 


pergons.. Decision making, howevet, is always coll6borative and involves °. 


; o 2 : a 
‘people and values as wefl as numbers» - ; : 
a ee ea = a = . 
Ihtsert Table 1 about‘here ; 7 : 
. nara Oe 
, aati alc cle ela tae are 8 
‘ : . Pe ae 
t. A general overview of.the data gathering and decision-making activi- ; 2 
' \ 
ey ‘tiles are. de&’cribed below. ia 
U 5 aoe ’ . 
, . ; 7 . . _— . af 2 


~Prpblem Selection: What are the prolytems that provided impetus for the 


"referral and implv‘the need for propram modification and special edugation’‘ 
r) ‘ ® . Pty \ 
service? ° / 


. ec 


i . oo 
This phase typically begins when a student is initially referred for 


consideration for special education -servtce. The problems precipitating 
a : | P 
Ene referral and specified on the referral form are the basis for structured . 


* “e 


anberviews — the student, iia/nee teachers, parents, and other —— ’ 


individuals.. Each perdon is asked to rank order the importanct of the 
6 . : . . . 
~ S e y 9 ‘ 


academic and social behaviors that a ae the referral. A sample 
a tanking™form is shown in Figure, 1. This list establishes an 
“ spective baie for deftnine the Avob Tents) specified in the referral 


statement and provides the direction for subsequent assessments. The 
> : . - 


.- 1's ‘ ny ; 


_ important assumption ip ak che student’ 8 performance on achool-related 
: . e 


fr] 


suctessful OF, unsuccess£til. «Assessment is thus ‘directed to specific 


v v “. 


areas of difficulty ae the school curriculug rather than to generalized 


‘The priority rankings provided by the ai most directly involved 


with the student © (including the qeudene) ude initial datq-gathering 
. a Ne 
activities. These consist primarily of determining both the student' 5 : 
wt 
current level of proficiency in the prioritized curriculum areas sie the 


. . ‘ J 


expectations for desired ‘per formance in these areas as expressed by 


a) 
’ « 


\ teachers, parents, school requirements, and the student on the priority 
. ry bg ’ 


- ranking form., Assessment of this type has the advantage of placing/the 


student within an instructional‘ sequence. At the same time, it eliminates 


a 


the gap between traditional diagnosis and remediation that is so trouble- 


6 
Y 
some to educators. 


. 
e 


° One important value of DBPM is that continuity of: data collection is \ 
- + ° ae o # 7 
preserved from the initial. assessment through program modification to 
outcome evaluation. mais the same ‘type of data which led to Judgments * 
, .- 4s? 


ane that a discrepancy er are used to make judgments about whether a 


> 


program *ts si at aud zinedty) whether the Droenam has been successful. ) 
This continuity contrasts sharply with systems ‘for cage a programs per 
rely on measurements of performance unrelated. to actual oTeeroan per-: . \ 

: férmance (e.g., individual #@tandardized tests) and that’ usually ‘obtain’ 


” ¢ 


data only at the beginning and end of.a program. “ : a 


tn many school systens, it is not uncommon for a student 8 ae 


| - bility for pectal education services to be determined by a school , 


iy . 


payieieet or other professional who works outside of Ene classroom 
7 2 . ‘ 
‘aeeeine and bases Ship Tpaihty dere on, aealiacates. intelligence 


q 


. or personality tests. Tf the stddent is declared eligibie for the _ ,* 


eas gervivess he/she must be ' ieeagaeceal® by svecial educators; since 


, . hd 


; : they. must determine.the kind of intervention to organize for: the stu- 
' : ¥ - ‘2 : 


: dent, they my use some kind of standardized achievement test as the 
‘ ) 


pasis for theti-dudamesits. During the intervention period, ‘the special 


o 


“4 edycator er ietts the available data on the student: =) performances \ \ 


7 these data peueretty are ee eatea by claesTapn exercises ‘and the 
N . 


. 7 . 


r 4 heacher! 3 Sek. Then, another standardized ‘achievement test may 


2 4 7 : 
be used to measure the’ student's achievement -upon program completion. 
¢ a 


Zach set. ‘of test‘results used to assess the studefit's pevioemarce is a 


7 discrete. unit that “has nothing to “de with Ber ennny or Succeeding gear 
4 * ' 
. 3 results. In fact, what is being measured may be differefives in the © 


various tést tasks rather than differences in the student's performance... 
Some examples of the types of data collected tndet traditional approaches 
\ a3 ; 


“ and the -DBPM model are presented in Table 2. ‘ 
— 3 (ie Soe oes easeeee Lo 
- Insert Table 2 spectare 
. : Communication problems among personnel responsible for-decision 
making are Seacerpaead in the traditional approach Ay the lack of con- 
e 
‘ o tinuity. and focus in data-collection activities. Further, the lack of 
comparability in tasks used to ieeeure performance throughout the -program 
; , modification makes it difficult to eT eee dean weaieen 


e : Fy ' « 
~ ® * 
. 


@« 


ef 


2 


° ‘ ct 7 ey \ 


cn oe Finally, pre- and sosenaabine, of Students, even when the 


e, : = 


, same instruments: are MBE cannot: be used 4s an 2 inion ieee: 


e 


- bay “Although the example in Table 2 is an Sverotmpliticatton, e dé- 5, 
or ee) mat ; 
. Pkets the greater degree of continuity in the data used | for en 


e 


7 o-, . " making in DBPM, and the potential ® clearer communication among all : 


. o ‘ _ 
persons ifvolved in the program modificatiom process. The formulation 


’ 
s ‘ Pa 


aw 
- 


« 


‘ + 
also fits with the notion that .the problem is not, a condition residing 


° . 
- : ‘ , 


« ‘ . $ 4 
_ : within the student; rather, the problem is the discrepancy that exists , : 
, between the Student 'p yctual performance and the performance desired e oe 
‘i : os ’ ; . ; ; .t . . A 
; from him/her. The eligibility decision revolvés around agreement on . .* 


A a . \ P “ 
“what the problems are and how important they'are, based on the priorities 


» is 7 ‘ 


that are’ established, and the, discrepancy data that are gathered. The 


magnitude of the discrepancy and the -perceived importance of the parti- 1 


‘ \~ 


cular curriculum to the individual Student enter into the decigion. ' 


: However, it also ‘is the responsibility of individual school districts to . 
2 st 4 eae : 

a prioritize ‘goats for programs as well as for individual students. ° These ‘S 
$ * $ ‘ 7 ~ 3 ‘ , o- - - ‘ 
{ B 
lso must! be considered in the elipdbility decision. : 7 : 

‘os : » : : : 


, . 


gram Selection:® What program plan is likely to be least restrictive ° 


and yet effective in solvin the referrer's roblems? : . ; aa 


NX 


Program plans quae adequately reflect the concerns expressed during 


: t 


nah ‘ problem selection. The exhaustive. nature of these activities ees 


‘ 


justified only if the _peount ing ptan is more AppropErate for dine stu- 


dent and a oe to student, ences and teachers than would other- 
a) 


. ~wise have occurred. - Ag fee ing upod | seat selection ee invo?. ae : 


e 


a a written plan that specifies: (a). the curriculum ateas in whfeh sig- 


4 a . 


nificant discrepancies have been identified, (b) long &nd sliowestanve 


ructional goals for each discrepancy selected, Kc) procedures for 
> F e to¢« wo : . 
: measuring, progress qn goals‘on a regular basis (i.e.,° daily or weekly), al 


v ¢ 


, at ‘least two teaching strategies to be, tried in an effort 40 reduce 


idéntified performance discrepancies, and -(e) -admtnistrative ‘arrangements 
< oe > . oe 
bd * . . ‘ ° XN ee 


* ~ 
_to be.used. _™ e . . ; ; os 
: ae Ac : . ; haa c 


The basit assumption in the development of altetnative Eegching 


’ 
. 
- 


* strategies is that the chances of solving a problem successfully are | . 


° 
foe e 


increased Lt multiple’ solutions, rather than just ohe solution,’ are. a a 

agai iapie. Ho peob ian ever has just a "single eoiecicnt: a number reed a 

alternative dolutions me be idee for algost any problem siaceeke rn 

offers some possib#tity of success. . by i 
: . 

The creat ion, of alternative Sg iicne de an important characteristic -- a 


? 6 
a "1 ‘ 


of DBPM. Le emphasizes an experimental approach te educational problem ge 


t 
‘ 


Solving..- The uniqueness of each individual, as well as our. present 


¢ 


a) ° . 


; we sR os 
state of ies in special education, take it impossible to predict : :, # 


° 


the specific effects of any single change or set of changes, on the in--° 


dividual. If alternative changes are devised and considered during \ 
“% . 9 a + . ‘ 
program: planning, then these alternatives can be testd to- find the 

’ . \ = e L 


& e 


> 


program tfat is’ most successful and to obtain cumulatiye benefits through 
J . 2 a , b, r ; . 
prqgressive ii oe up ehracat rons in thé existing Progra. Fur- | 


ieee: by making explicit the profZram plan,as well.as the ch inges to “ : 

r ’ ‘ . ‘# € - ; ‘ : 

be made in a student's educational program, accountability and.shared ; \ 
. ok ; ‘ ; ‘~ 


responsibility are increased by establishing a mutual commitmegt to a 

common goal, making piven is responsible for the program decision, 

how those decisions are a aise when program changeg witl bd daiated, 
The beyear central element of successful DBPM is the epaphed record 


, ” 
of studefit development on the identified discrepancies, that ar¥ the 


“ , : < 
t ° 
, : 


: : . . ; | : . 
. focus of the program. A graph of observed development over time (time . : oe 


'. is a-line showing che onestesone rélation between time of mastery and 
y . . . 


‘ 


. ° : : - yy 
series data) provides the information needed to make critical decisions we 


about the student's movement from past to present status in -the program - 


e 


"of instructign. Further, it affords rom te for predicting future 
« / : 7 > 


development under different instrtictional, métivational, and/or ad- 


ee araye arrangements. In bie Pus run, ‘the es ie . 


changes in the «student's devetopment and aa aa ca the program ides 


the data base for mgking'eValuative,judgments about -special education 


° ’ 4 eos i 
intervention. : fig “Wes ee , ¢ 


s as 
2: ‘ f . 
In DBPM, two basic graphs ara used to display daily, weekly, and 


¢ a 
° 7 . ny 


_ monthly data: _ 
1. ogress (or Mastery) Graphs _ ; 
2. Performance 'C¥aphs..° . - 
. < 


v 


4 


Progress (or mastery) graphs. A progress (or masteW) -grAph is é 


» * 3 ._ &@ ie ar] 4 . 
constructed to display the time a student takes to mast et (usually, « ~¢ - 


a over time in terms of sequence andYor complexity) of instructional 
‘ohjectives. In constructing the weenie the series. of A on which 


the student is’ working and the time in which they are expectéd to be 


_ achjeved is shown ‘on the ordinate (up the left sidé); the time in which © y | 


~~ , 


the student working on the objectdves is shown on the abscissa (across ~ 


" “6 


the bottom). A point’ is Plotted at the intersection of the relevant 


vertical time line and horjzontal objectives line whensmastery has ~\e 
occurred, Points are plotted sequentially and connected; the result 


Lf 


s 


’ ‘ 


‘time in school. 
: 5 


The progress graph can be used in any classroom or program in which 


> » . 
rx ° m PA ; 


Re 


etm, or ‘they fay be _requirenents ‘embedded within a particular cur- 


ate independ® t “pf si aici capeieuiun the seating of objectives ha 


specified tasks to be’ mastered cones saeueeree in relation to time. oS ; 
ae aah ; gk ee ‘ . 

. ’ 
‘Thes.tasks may be objectives! that are independBnt of any particular 4 


* 3 . ~~ . 


‘ 
“e a . 


sequence.. In “the objertives-— ~based approach; where, the tasks a Te 


*s rs id 


> o? o. me ae sy 
. é 


ayia 


~ t ao ¥ - ry nF 


to be at tadited and® the came allotted for aera samen sare laid out ‘on the 


. ~ 


a i = “. ay ; JS 


lordinate, ‘and the ‘days, weeks, or months of ‘school attendance are_ eer 


? « 


"on the. sbsciasa._ In ‘the specific curriculurt gnd wuretculim-sagyencd : 


~n 


y ‘ : * 
or: months and the ordinar Ows, the’ 


do, ean time periods. On the vertical axes, the tasks are spaced gecord®ng 


we a, es 
the’ graph organfzations forthe . roaghes. ." | 1. 
\ een ~ @ , 8 ; ace as : $ be x 


a 
veo” 


"approach, the absc{ssa +s, also labeled. for: Fee in school by, dais, vweeks'> oe 


- @ 
urrdculum shauence ané re “cime oS Ue , 


‘ * oe e » e ee 


. ee o o . 
allotted for attainment of each*ieem*of ‘thetsequence. _Figure 2 illustrates. . 


. ye eo i 
2” A . : .° 5 Ste 


’ a * 


con approaches, the” ‘euaph is a square drawn on equal~interval : 
Ld 


- . ’ Py ~ 


sane Qn- Goth axes, the same numba. 2 of lines are marked. tp tepreserty.. 
‘ « oo 


o . 
- 
o LJ 


to. the mastery time expected af average students in. the curriculum. a 

hee 2 . Peas ar ; +d . x ue % 

Thus, the’ graph is organizéd so that’ for the average student the Ievel Ww 
: 2 € ages . 


“8 


; One - Z . an te , . . e 
‘etprogress (mastery) is one to one: For each week, month, or year ‘in ‘ 


fed : ' ei ieee 
nt, . 


e program the’ average student is expected to master the number of 


4 


oF 
e 


tasks designated for that week, mon en, ar ‘year. If achievement of 
i . 4 ” «3 v. . i a 


average students Pg proetee week by wee; mon “by month, and year by *, 


Pe 


~-year, the line éonnecttng these points is a diagonal from the lower . 


- F as i 
: 3 ; 


left corner to. the upper right corner of ‘the ‘graph. 


10 ° 


bo ; 7 : - * 
e? For the ret st the progress level usually differs from the - 
. ° one-to-one ratlo because, t ically, he/she has not achieved a week's, 


month's, or year's progress 


n the designated time period. Thus, when 


. 


the target student's mastery level is ‘plotted on the graph, the dig- 


sergpancy between his/her Wrogress. and that of- average students is 


cr ° 
ss. Ay a graphically {illustrated by the Maen oF progress points” from the 
4 diagonal line : average progress. . _ . . : 
‘ 


- 


Performance graphs. A performance graph is designéd to display how 


a student's behavior. changes: on a single eal, such as “oral reading from 
< Pp: 7 t 
‘ * 
an age/grade appropriate test" or ee behavior during work Veamé," over 


a. On the performance graph, the abscissa again’ shows the time .in days, 


f ie . ; 7 : 
F , weeks,. or months of the prdgram during which measurements are made. The . 


ordfnate simply shows the level of performance on that single task ‘on a 
‘2 : : 9 . a : 
oy day when that performance: was measured, ‘Thus, in Higure 3(a), the ordinate 


4, (vertical axis) shows the number of words aad correctly and incorrectly. 
per minute; in Figure 3(b), the ordinate shows the number @e Sft cack 
behaviors pet minute during work time. ‘ ; : : 


"» em mi ii ae ae 
vo : 


. ~ , 
f ; , . : ; . 


; : . Either edgal-interval or equal-ratio graph paper can be used in de- 


ot \Scetesing performance graphs, depending on. which is preferred or more use- 
'ful. In both forms, thé vertical lines represent calendar dates. On 
er 
susie inecevad graph paper, the equally spaced Horizontal lines can be 


a designated to represent a atte, percentage, ‘or rate (frequency). On 


' : 
” sunsets adh a ai the horizontal lines are a6 drawn that. perform 
=” a 


ance changes which are peeporedonakely. equalsare visualized as equal/ ~ , 


Since a change in behavior from 2 to 4 isa "two times" increase (i1.e.,e- 


, 2>x 2 = 4),-it is shown as equal to a change in behavior from 50 to 100, 


« ‘ id 
’ 


14 _\ = , 


] 
~ 
| 


a& 
~~ 
_ 
_ 

a 
> 


which is also a “two times" increase (i.e., 2 x 50 = 100). -_ = i 
Equal-ratio, aa Aaa is semilogarithmic (multiply and divide) 
hy t 


rather tan adeitive and ,has yea popularized, ghrough Precision. Teaching a 


a ‘ > “a 


Py _ as thie Standard Rehavior Chart (eenueneiak. Koenig, & Lindsley, 1972). 


What 1 is often obscured in T cassicandtet the relative merits of equal- 


Interval and equal-ratio graph paper is that both display the results of 


‘regular and frequent measurement of student performance over time. Both 


are designed to permit analysis of time series data. The’ only real dif- 


ference between the two is that equal-interval graph’ paper emphasizes 


ut ‘ 


absolute differences and equal-ratio graph paper, emphasizes -relative 


differences. “ 


1 


Ehoosing the right graph. Whether a progress (mastery) graph or a 


__. performance graph is used nase solely on the kind of data needed EG, 


Ps make Program modi fication decisthng: sad nw rate at which a student is a : 


, 


mastering a set, of tasks “is isfortant, ther a progress graph is most’ a 
: 


useful. Lf" changes in level of performance on. individual tasks are more. / 

' daioeat, then performance graphs are likely to be lost helpful. eae 

. Seachers devekop and maintain both kinds of graphs hecsise they ° are in 

; terested in both kinds of data. ; - : ue 
Listed in Figure 4 are’ some examples of heneuiies tan can be 


e 
oe 


&rted on performance and progress graphs. Note that the level of 


specificity in the ‘examples increases with the frequency of measurement. 
i (-- - 
Insert Figure 4 about here : 
Be ee es ee ee ey “a cs _ ae we ‘ 
oo, w * " 
Medinet, The choice of time period for the construction of the 
graph depends upon the length of the curriculum and the pinpointed be- oar “ 
: haviors, | Monthly progress graphs can be constructed for curricula of 
a 
& : 
o_ 
ERIC - ( 
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. a. 


F . .° er 
12 : ‘ : a 


ys any ZEREEN: eopendene on how many ae ‘each cnr iailas spans. «Or, 


- a progress graph of che appropriate time period (1/2 year or 2. years) | ~ 


: ‘ could be made f£6r any part of ‘the uate. If a math program were 


- 


‘to extend over two years, the monthly progress sraph would be ‘constructed ‘ 


‘ ‘ ‘ 


ae a } 
for that period. Graphs to record weekly or deity rates of progress and 


° 
¢ £ 


performance work best when-they aré limited, to péritds of one school 


» 8 . 
year or less. | : 7 ar,* 
- ° bd t 


Descriving discrepancies visually. On a progress ee perOenaice ‘ | os 
akaoh: it is possible to illustrate visually ‘the ie ccennnes between 
the is student ' s progress or performance ani that of his/her. peers ] 
who ave picgresnine or performing CONST ELERe with ai expectations , 


* 
and, hence, are considered to be "average." d 


Thy weekly progress graph shown in Figure 5, for example, visually 


e 


‘ $ : te . 7 
F tllustrate& the’discrepancy between desired mastery level for average : 
° 7 a : : a . 


_ Students on a set of math categories and the referred student's actyal 


: mastery level on the same set of categories. - a. : 


- - Fe ew ere ere we Be KF KF Ke Kr Kr He em | 


The daily performance graph shown in Figure 6 is a visual repre- ct 


, 


’ sentation of the discrepancy between the number of words read per minute 


in a textbook by average ests and the number read per minute by the: ~ 


a 
target student. (For reasons of space; the graph has been cut down.) 


» 


. 


The visual display of discrepancies usually provides a mieasure for 


; a : : 
communicating most clearly with staff, parents, and child. Many decisions 


‘6 


& 


: : . . 
‘ . -« 
| : a . : : 13 
_ can be ba\ed on visual displays alone. “When more precise informagion ts ee 
| ‘ required, a the discrepancy also ee described numerically. 
- Describing discreyanctes numerically. To compute a numerical dis~ . 
F ° so for a ‘progress graph, two" items of apeseuatie. are eee i 7 ° 
, =. 1. ° The desired level of progress, (mastery) on the ‘set pf cache 
~ (1.e., the curriculum ‘units or cieecivesl for a‘reference. * _ 
e ai en of students (usually the average of the same agad peers). 
- _ 2.” The sebuah Revell of progress‘ (mastery) of the’ referred student 
x on the sac of tasks. 
” When the. desired. and actua] levels 6 Arebieds have been determing4, 
, ‘ : 
the distrepaicy ration whith is the relative eee Berused- the wo . 
- levels, is easily computed by dividing the higher eget of wee 


the lower , level. The esule of puts division always yields a number th 


te f A 
. . = is greater than or equal] to l. 0 aad specifies the number of ines one 


cad 1 


ad level’ is greater than another. eres the resnte te 


e x 


> ae Pa “+ 


forming on ‘the set of tasks than the referred student. 


ry 


( 2G In Figure 5 an individual student's mastery of math obje 


plotted. To determine the discrepancy ratio for thig stude 


a the numbered steps. e000 ; 
| Step 1. Determine Actual Level of Progress., This, 


number of weeks (months or years) of progress achieveg in the time al- 


s 


ready-spent in the instructional program. In Figuref/7, we see that the 


us student has beén’in the program for 16 weeks. Yn 
, . e ‘ t ‘ 


mastered Level I material, which is equal ,to fivf# weeks of progress for 
* ‘ / y ‘ . 4 


hat time, «he/she has 


& 


average students. 


. 
6 ae 


a gg 8 Stey 2. Determjne ‘Desired Level of Progress. Destred ‘progress is’ 
/ f 


a 


ns *° ie a , 
Fi \ “one week tor. each week "in the pROBT am: oe the graph were developed. ~ . as 
r f 
rs Pot units; of ‘days, months, or years, desired progress would be expressed 
i sscorsiohly. The important point | is that on progress praphe the relation ee 


a is: always one to one} one! unit of progress for one unit of time. ), 
. ] , 
Figure 7, ¥then, a ‘student who has been in the program for 16 weeks should 


a /have mastered 16 weeks of work (in this case, Level III in the Eos 
oy e 


ry . , eS Os ° 
v. 


Eo i . 2 Step 3.' Compute the Discrepancy Ratio. The higher level of prog- 
ig & non 


ae a ~ 


a 7 ss 


ress must be divided by the Owes level of \progress. The ormula’ is: 
Py \ . 


ne aa : ’ Larger unbee (Level of Progress) 
ee ae : Discrepancy Ratio = Sees 


; a »£, P ess) 
Pe e - 16 weeks 3 - 
7 ‘of ail ° ra ‘* " e = : = 3.2 imes « , , 7 ? 


; . & ” ; ; ° ‘ : 
L a 5 weeks } ; ' 
? . F Fs - Be, a 


ra ‘ ¢ 
. ' 


\ a 


Since the discrepsincy ‘yatio tells how aay times gesyeae one tevel of 7 


progress ‘is than another, the derived 3.2 inatenees that students prog , ae 


. 


! 
ressing at the desired rate are progressing 3.2 eines faster than the 
ao ove ’ 
target student. (Conversely, he: target student is progressing 3.2 timés . 
. , 
slower than the desired rate of progress. ) _ vloe 


: \ . * . E ” wD ay 
: ' i a ’ 

8 .. To compute the discrepanay for a performance graph, two additional 
items of informatton ave needed: ;  ¢ a 


. 


1. ° The desired (usually the median level of performance of "4 
, ‘. average students: on the skill or behavior of interest. } 
me, SS 2. ‘ the agtual (ass tuy level. of performance of the referred 


student prior to program modification. © ° 
‘- - 4 The median is the score that’ divides hie distribution into hates as 
~ 50% of the scores fall below the median and 50% above. The imeqian, * j 
along with the mode and mean, are measures of centtfal ‘tendency. Any ~ 
of these méasures may be eee but the median is ie because ‘it 


an is less sensitive to extreme ‘scores and ‘i , relatively easy to compute. . ©, 


‘8 


the same as fqr th progress ‘discrepancy ratio: Divide the higher level : 


of performanc by he lower.» The “result is a number greater than 1.0 
. 2 - ef f ° 
eumen of times gredter ¢ one level of performance is 


a 1 that a th 


. oy * ae 


than the other. 


t : 


In Figure 6,/ an individual student's performance in oral reading was 


6 plotted. (The d strepancy ratio in oral reading performance\petween, this 
{ ibs : - ‘ 


student af average atudenta tn the les is computed as follows: .. 


sth, Lt etermine Actual Level of f Performa nce. There are ll data 


75 ~~. we find et the feditan (or “date aes ts 52. This iy ° 
| : : p . - ae Wh 
is actual /(baseline) performance for the referted studeng. Note that 6 a 
amp le“of performance had been available, we might have a some- 
° . . : . v . x ” 


Determine Desired Level of Performance. Median performance | 


for a erage students in the Bchofl in oral reading is 100 words per 
* : ates e. ,This is desired merformance. 
| Step 3. <esumite the Discrepancy Ratio. The higher level of perform- 
ange must be divided by the lower level of pee Nasaces * ‘ | . - 


’ 
’ 


Larger Number (Level of Performance) 
Discrepancy Ratio = _ 


> + 


. Smaller Number (Level of Performance) 


; 100 
= e= 1.9 times 
ie “HD 8 


: roa 
? : : ; : 


s 


In this case, the discrepancy ratio tells ‘us that students who are 
readfng orally at the desired ‘level are © performing 1.9 times faster than 
& Paghh 


7 -) 


* . ‘ 
Q - ry 
o* ° 


. 


e e t 


the referred student (or the referred student ‘is 
, . . 


1.9 times slower). _ 


: a. 


Another example-is where desired performance = 20/min. and actualy 


performance = 20/min. ~ my \ - . 
In this case: ° _ — 2 ‘ aS 
Larger Level of Performance ~ 20/min. | 1 sa ; \ ra 
Smaller Level of Performancg 20/min.. ee a \ ot _t 

: ; ; ; a : ; 
Thus, there is no\discrepancy. lf desired performance = 30/min. and a 
actual performarice = 60/min.: : : e ae : 
ve . $ > : ar 2 
‘Larger: bevgel of Performance  60/min. bee ’ : ve 
= ———— *.2 times _ 


Smaller Level of, Per formance 30/min. 


Thus, actual performance is 2 times faster than desired performance. 


Pragram Operationalization 


. 


Once a program has been-"oper tionalized," four key élements must | 


¢ ' ‘ 
° ¢ 


- be observed. , 


1. Goals must be clearly identified and progress on the goals ust 


be measured frequently. A majox een instructional failures is. 


‘ 


e 
s 


. ’ aN 
that goals are'only generally defined an see is measured only < 


occasionally (Bohafinon s 1975; Hofmeister & Crutgher, 1975; Jenkins & 


Garrafa, 1974). Although teachers, often belteve that daily interaction 
with students provides sufficient basis for evaluating student progress, 


ad ° t 


the belief is founded on faith, ‘not facts. Coal setting and measurement 
4 es - car * 


are essential to™any attempt to change students' progress/performance. 


9 


es program must be held constant long enough for its effects to 


appear. When teachers decide to initiate new programs for children 
> with lentaine difficulties, it is not unusual for them to change differ-— 
ent aspects of the programs on an almost daily basis in their zeal to 


make a difference in the’ children‘Nx progress/performance. Such frequent 


. 
1 ~ 


o 


- <a - shanzel tb Insbmuctiien age self-defeating, however, for two reasons: e 5 ges ; 
_ (a the wet cots OF the causes cannot be ‘evaluated, und (b) “any Bie 
7 . tially yenettctathcnane, may be dwt avaed before oe 
: ® “otten, | eeoiee attempting DBPM for the fixst time find it difficult — ° 


i - » oe 
‘to be: Sonnterent in ‘daily instruction Because they feel “frustrated when | 
. ~ ‘a » . 


¥ 
imfediate results are por apparent. Yet, pnce they conquer these ini- ; .* 
d eis to 7 _ 


“7 


ny 


° ay 


oe rs tial frustrations, ttre same teachers find it possible 


adhere, to Byeeemapac consistency. 


' 
.> : 


3,° Data anoutd be used to male Netdnechat e decfsions, but some 
‘ ; ‘y 


aspects ‘of the prograin shoyld be changed ’ ENEry 15 school. days (3 weeks) 


‘ or after 15 data points, whichever comes Myst. We recommend as a. ~S oe ea 


" that ‘some ‘aspect of the program be changed every 15 


a ‘ ° . on 5 1 ._* 3 

' school days or data points, regardless of how well the program may be cs 
: e . 0 

» 


—— going. ‘This recommendation 1s not difficult ,to follow, given that most Y 


e , a 


‘rule of thum 


. 


teachers eer many nevecee of programs daily. EOeEWeS) it may be - 


“tempting to shold a program constant giieh a change is leading to pene aed 


° 


solution. Still, we cannot Enos whether a current program is the best 
’ . , . . e : # 
“ possible 6me unless we regularly (every 15 days or data points» make 4 


o 


ok ‘ : : 
changes in at leabt some aspect. of the program to see eenGe an im- 


provement is possibld.. Simply aed ca or decvenetnk the amount of 
: * . time that is spent each day on a paeee diay instructional activity, is 
d change, an it may lead to improvement: When a change is made that 
decreases progress toward goal attainment, it is nooner to change . . « 


t 4 
‘ * back to the previous more successful program. . - 


. ° : , oe 
- ' | 4. Periodically review program activities to insure that the 


: ‘ BY , 
2 program is being implemented according to plan and is agreed upon by 


‘18 ; an -: ie ? | 


. F \ bd 
those concerned yith the referral. The effectiveness of a carefully ‘ 
; : : sd ee 
es planned and sele d+ program can be tested only if it is fully mye 


mented. ‘Often, a true test of a presean is not made because the seopit 


—~ 


, - + who are responsible for cafrying out ‘i portant as ects have not done 
ryin yp 2 pects : 


1 . a ” 
Py ‘ . a 
-. . ‘ 


fas 
so according to the plan. With periodic ‘reviews, the exPene to whic}t , 


» a ° . 
© ee the program as ron is heine Sapllemanned cari, be. evaluatdd and any , so 2 


r ae 
* se 


. differences which are detected can be? reoonciled. Periodtc reviews: 


: « 
~ i my . : 
v 4 


= increase the likelihood that an adequate test at a sotentially benefi- 4 


ctal program will be made. In addition, by formalizing communication 
; to, among the persons interested tn the student's progress, periodic reviews a 


4 ‘ a 


. prompt and rednforce ‘the sharing of responsibility ‘that was oe * 


dining, problem and program selection. fy 4 = ; 


‘e * 
e » Pa 


Program Improvement : Does” the program 2 as _implemented appear.to be moving 
6 . 


toward problem solutia 


een can saan certainty: the specific programchanges’ that ; 
= 


will sanate an academic or social discrepancy; “guch changes can be» 


’ 
“identified only through the systematic ‘testing of aiternatives. Ato ne i 


v 


contrast to teaching as-it is omirfarily conducted, DBPM As a cont inuous 


’ 


oe evatugpton design in.which programs are deliberately changed and the . 


effects of each change are compared with the effects of previous. program. 
é 


- changes. Such : counaeieane enable objective decisions to be ihade about ” \ f 
, , 


vw (of 7 


a . which entices: lead nose rapidly to problem solution and which-do not. 7 


‘ ® + “ » af ¥ _¢ oe 
when, programs incorporate the datactaaed ae Ate oytlined Here,’ they #4. 
Xu 
have au evolutionary quality; that is, successful changes survive and 
. vA ; id a. . . 1 a 
becoma a part of the program while unsuccessful changes fall out.. The 


e 


t 


net result of such an approach is the construction of a program that . 
5 ©. 9 


8 


we i , ; «| * . ie v 

s . 99 

ERIC ae a 
ENC ae ; © sn 


(<) 


ERIC 


JA Funrtoxt Provided by ERIC 


- benefits adds ‘two steps for progress-evaluation ‘(Steps 5 and 6). 


\ ’ ‘ . ’ \ 

ae ‘ S . ° a 
; - ‘ : x 19 
a , ; . ° . ‘ saviae t - 
: - ‘ ° : ° . 
is.cumulative in it's effect’ on problem resolution. 
fe a es ef . , po ot 
The followjng review of the procedures that produce these cumulative ~—* 


‘ 8 : . e 


1s During roblem selection, conduct an initial assessment of 
. ; o r : . ’ 
performance discrepancies to clarify what Broblemg emase and to aid in 
? \ . ¥ 


determining Péiorities among problems. The data collected during ini- ( 


cy i .e ‘ 4e 


¢ bd ’ 
-_ assessment should eatabiien a oe against which subsequent 


owe, a J: 
program rect Mdeelons can’ be tested. Continuity in programing is: es- 


see . . Niied 


tablished as the dgta collected initially are ene same data that: ere, aa 


used in ‘later. —  evatat Nn oo , 

2 ‘Hor lne ‘program planning, canetulty develop a plan containing ‘ 
several Jip ernatiee program changes that may lead to problem solution. . 
Attempt to piedirathe welcwe eau and effecta-of different ditevharives: 

e a ; . 
and develop the attitude that what‘we try first may work, but if it does 4 
not, we fave other solutions to test. > oo * x‘ = _ 

3. During program implemea tition, undertake implementation é alua- 


tion ‘to insure that the program which was sélected “is actually in opera- 


tion. Improvement of the program will require a data-based decision about 


. 


the extent to which, the program modification has had good effects on the 


performance discrepancies. For that reason, care must be taken to insure 
e 


3 2 
that the time serias data collected during initial assessment gre also 
m ‘ 


recorded and “graphed when the program plar is implemented. + 


4, Change some aspeét of the + prearem after 15 data pores nave: been 


/ . F 


.5. After a maximum of three changes have been made, compare the - 


plotted or cerec weeks, whichever comes- first. 


‘ « \ 
data obtained prior ta each program change“with the data obtained after \ 


r 
é 


ke 


each program change to determine a | clear change in level or 


.; 
\ ae bath . . ; 4 


rs : 23. : < ae ag 
. he 


ee 
direction has “resulted. “4 5 


“.-6. Maintain those changes which have resulted in program improve- 


° 


ment and drop those which have not led to improvement. . _— : 
: ; 2 
Adherence to this routine leads to cont inuous program improvenent, : af 
and a fimacovensit is reflected in tite graphed cata. There is no + 
gudsantee’ that each program change will be- successful, but you ae : 
‘ eee, Loe 
know when a change Sroduces demonstrable Success. . 


Learning to interpret graphs is like learning any new concept. You , . 
a ‘ , 
must peeoe with some app eecanee and feedback until you become’ Pro— 


° 


figiace, 


. . . &. nw 
’ a : . : 
a e 


Program Certification: Were the problems solved ‘through program modifi- . ( 


e 
¢ 


catton? oo ‘ 
cation : + 


_ Certifying 4 Storvanite be enttakactoesit ‘completed, like the identi-; 
enon of import aut problems, involves both objective and subjective 
judgments. Two bppee Se ebteceie: data can be/obtained from the record . 
of a student's. performance which indicate that a program is suiceeaeful: 
| 1. Data showing that the progress/performance disctepancy has been 

completely reduced (actual ovrEocmanee and desired perfgrmance ‘<~ 


, lines are identical). 


* 


2. Data showing that the program as currently implemented will 


: e 


result in a complete reduction in the geccrepancy by the end 


of - aehool" uae (indicated by a trend in the data that; 41° 


ry . 


projected, would eotnelie with the desired performance line). 
“Although objective data are central to DBPM, subjectivity is always 


a part of decision making. Because subjectfvity has a Significant in- 


. 
. 


fluence in decision making, it should be controlled as much as possible. 
f- : : 
4 


rs 


w 


(<) 


ER 
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4 


{. 


4 


_are the most récent discrepancy ratios for each behavior. for which a 


~ s ae 


In DBPM, the eeactel 1d gueroteed by askae Subjectivity senirett 


rather fhan | implicit and i embedding ¢he values th t influence program 
& e * ~~ ' 
certification dectiiote a a systematic framework. 


The srocedéres “t5 program certification are “rdentical to the pro- 


cedures thdt are usedyin ‘problem selection. nat ever: date were the basis , 


for determining eligibijity in the: first place are now the basis for’ * 
‘ : , y ¢ ” : ‘ -' i 
determinjng whether. the program has been successful. The data needed 


7 ~* o 


, . . : : 
program was devéloped and implemented, as well as data on all previous . 
’ 


programs which were developed and completed during program implementation. 


All parties to the eee should be présent (or at least invited ok 


. to participate ®in this decision. The data should be presented and each 
person (theluding the stone. Lf appropriate) given the opportunity to 
review the data, comment' on the recommegjations, and cottribute addi- 


tional data or recommendations. 


The importance of making desires explicit at the outset of modifying’ 


a program is manifest in the program certification process. Agreement 
should be established tn writing as a part of the original IEP. If 


agreement is gbtained, then individual values regarding the problems 


r 


oy alls importance are negotiated well before consideration of whether 


the program has been satisfactorily completed. Thus, the IEP can be 
wh : , . 


used as'the, basis for negotiating eventual program certification. 


* 


“Gallagher (1972) made similar recommendations. Explicit contractual ' 


saree ee at the point of initial program modification pp to ey 


a 


potential conflict at the point of program derminagieds 


vi 
is & K 
a 


fe -See'P.L. 94-142 regarding parents’ and students’ rights to attend 
and participate. ; 7 


{ ‘ “ya ‘ : 
‘be noted that many problems can be. solved more quickly and 


rs 


. ’ 


4 It sno 
simply, by renegotiating desired performance. To.do so requires that ® 


the gndividualls. “esponsibie for the ‘davelopment of studentg* educational 
a _— . < ss 
oN 


. ~7 a 
\ 
realize that changes in desired. performance. aré reasonable. If 


“ aN * 2 
, “programs 
& ” 


s P ; . a . | 
. "our schools aré to be pduralistic, in the same sense that .we presume our 
- ae. — .3 : 
American society is, then we must be open tq alternative developmental | 
. : i." : 


° 
. 


To require all children to learn 


e 
as ‘ 
« , ra 


. 
vee ag’ 


ow 
; ~~: ‘a . > ° ad . ¢ : 
_ goals ag well as -alternative programs. 
to.do or to become the sate (i.e., desired performance to be the sam 
fbr all children), from this viewpoint is inappropriate. One’ of the 
Ok 


responsibdlities of program modifiers should be to impact on people's ° 


desires as well as students’ performance. 
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, . Decision Area (Question) 
: ? 


Tabla l 


Data~Baséd Program Modification: 


VE * 


Program Decisions and Data-Gathering Processes , en es 


40) 


Problem Selection 


What are the problems that 
provided impetus for the 
referral and imply the 
need for program modifir 
cation and special educa~ 
cation service? 


Program selection 


What program plan is tkely 
to-be least restrictive and 
yet effective in solving the 
referrer's problém(s)? 


Program Operattonali gation 


Is the agreed-upon program 
moddfication being imple~ 
mented aby anne? 


Program Improvement 


Does the program modification 
as implemented appear to he 


moving toward problem Solution! 


’ 
° 


4 


Program Certification 


Were the problem(s) solved 
through program Rodi tseatton 
(intervent fon) ?, 


= . , , . vk 
s - 


Data-Gathering Process | 


Initial Needs. Assessment: 


1. Determine: who oq performance expectations for me 
‘the child, 


‘2. measure the current levet and directiog of tire 


child's performance, 

3, compute the discrepancy a between the per- 
formance expectations in the child's environ- 
ment and ‘the child's actual level of performance, 

4. establish the importance rating (value) of 


the SEACTRUAREYS . 


Progran Plappén ag . . 


1. Develop pogsible long- and short-range, instruc- : 
tional goa related to discrepancy ratio, ‘ 

2. plan alternative instructional strategies for 
achieving the goals, ‘ tina 

3. recommend alternative administrative arrangements, 

4. estimate time and resources necessary for attdin- 
ving different goals using different modifications, ,, 

5. spetify forces working for or against different , 
modifications. 


. 


Implementation Evaluation (Intervention): 


1. Al raise discrepancy between implemented program 


planned program, © _ 
2. ES reasons for discrepancy if one exists, . 
3. propose alternative ways to reduce discrepancy: — . 


= eee planned and implemented program: 


. ‘Progress Evaluation Intervention : 


‘1. -Appraise progress on shqrt- ana long-range a 
alternatives; ~-.... Y . 


2, propose alternative revisions for programs: that, 


apparently, are not affecting performance yreigly, 
Qutcomer Evalvdtion (Nonintervention): ; 
-- Determine whether modifications have been 

« successful in eliminating the discrepancies 


-, which led to initial referral. < 
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j Examples of Types of Data Collected 
» ‘ . 4 _ : « oy 
a 
Decision “Traditionally DBPM ss yr _° 
a ee a a 
Eligibility WISC 1Q Discrepancies on mainstream 
: - « curriculum tasks: : 
Stanford Achievement -oral reading . : 
: - -comprehension _ ; 
* a . California Test of ~spelling .° . . 


’ Personality -math computation and concepts, etc. 


° 


Discrepancies in classroom: 


1 -hotse : 
7 : ; -physical contact 
a ". -out of place ‘ ‘ 
‘ . -off task , - ea. ° 
\ . ‘ _ social interaction, etc. ae 
s 


; . Program Objectives ITPA Same as: for Eligibility 
. SRA Reading and . 
. Math : , 


Informal Reading 
ee ( \ Inventory oe 


Progress Evaluation Percentage of Same asfor Eligibility 
jectives mastéred v2 : ss 


Teacher estimates, 


- "End of book" tests 


ree , = Program Effective- Wide Range AchieVe- Same as for Eligibility. 
. - ‘°  mness (certification) ment Test : 
4 e * 
Behavior check}ist 7 - : 
urrent curriculum — , No , 
. : ? placement . 


.° 


fh 


- . ‘ 
ral cy fa ° 
, % 
% 
’ . 5 
27 16 
.- 7 
4 
* 
(= . X\ 
. ea * " 
a ee ” a 
w a! 


« 


* ; Directions: May be attached to referral form. Ask each person concerned : eo, 
ve ~, with cs to complete a forn. 
| " r a , ay ‘ .! ‘ ' a i * 
hare : Referee: . A - bh 4 - Age/Grade_/5/ ; f c_/Q vate ® } / Aa/ 7> _ 
: b.” *s j a ‘ , 
. - Name of ere completing this form: WAH . Jf tre. 
’ * Specify. bose goal (terminal) behaviors which you would most Like cai see. ° 7 
satan h program modification. “ ; 

m ; >, : 

. «+ Acadenfic -, : o, “* AQ : : oe y 

’ ‘ Acceptable Level of Performance + — . 


s 


a ba . 

he % r 
After you complete your list, rank order tHe list in terms of those most J 
requiring immediate attention. , e : ’ 


: ! : : 7 = " ° 
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Figure 1.” Example of a Priority Ranking Form 
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Cumylative - 


book ‘cot- 
pleted in ° 
.basal tread~ 
Ing series 


Suqulative 
librevy or 


paperback 
books read 


Cumulative 
units com- 
pleted in 


‘ymath curri- 


culu 


Cumulative 
contracts , 
completed 


Lgunp 4, 


Cumulative 
stories com- 
pleted in 
basal series 
Book A 


Cumulative , 
chapters 
completed 
in book 
each week 


Cumulative , 
objectives 
completed in 


/ math curri- 


culum 


Cumulative 
contract 
objectives ~ 


achieved 


Jixamp tes of the types of data Yhich 


Daily 


ry 


Cumulatd 
pages co 
pleted in 
basal read- 
ing series 
Book A 
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pages com~ 
pleted in 
yook each 
beok- each 


cmuiicies. 
worksheets 
completed 

in math 
curriculum 
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daily.ob- ~ 
jectiven ~ 
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Monthly Weekly | Daily 


# of Words 


read per 

minute 4n 
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# of Words 
read per 
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reading 
material 
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